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Abstract 



H 

on 

This paper explores the joint behaviour of the summands of a 
random walk when their mean value goes to infinity as its length 
increases. It is proved that all the summands must share the same 
value, which extends previous results in the context of large ex- 
£> . ceedances of finite sums of i.i.d. random variables. Some conse- 

| quences are drawn pertaining to the local behaviour of a random 

■ walk conditioned on a large deviation constraint on its end value. 

. It is shown that the sample paths exhibit local oblic segments 

I/"") | with increasing size and slope as the length of the random walk 

o 



increases. 
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1 Introduction 

1.1 Context and scope 

This paper considers the following question: Let X, X ly .., X n denote 
real valued independent random variables (r.v's) distributed as X and 
let S™ :— Xi + .. + X n . We assume that X is unbounded upwards. Let 
a n be some positive sequence satisfying 

lim a n = +oo. (1) 

n— ¥oo 

Assuming that 

C := (S?/n > a n ) (2) 
holds, what can be inferred on the r.v's AYs as n goes to infinity? 
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Let e n denote a positive sequence and let 

/ := H™ =1 (Xt E {a n - e n , a n + e n )) . (3) 
We consider cases when 

lim P(I\C) = 1. (4) 

The relation between the various parameters in this problem is of interest 
and opens a variety of questions. For which distributions Px pertaining 
to X is such a result valid? Which is the acceptable growth of the 
sequence a n and the possible behaviours of the sequence e n such that 

e n = o (a n ) (5) 

and is it possible to achieve 

lim e n = (6) 

under a large class of choices for Px? 

In the case when the r.v. X has light tails conditional limit theo- 
rems exploring the behavior of the summands of a random walk given 
its sum have been developped extensively in the range of a large de- 
viation conditioning event, namely similar as defined by C with fixed 
a n , hence lower-bounding S n /n independently on n; the papers [9], or 
[T2] together with their extension in [TT] explore the asymptotic prop- 
erties of a relatively small number of summands; the main result in 
these papers, named as Gibbs conditional principle, lies in the fact that 
under such C, the X^s are asymptotically i.i.d. with distribution IP 
defined through dli a {x) := (E (exptX)) -1 exp(tx)dPx(x) where t satis- 
fies E (X exptX) (E (exptX)) -1 = a ; in this range (jSJ) does not hold. 
The joint distribution of X±, ..,Xk n given C (with fixed a n ) for large k n 
(close to n) is considered in [B] . 

Extended large deviations results for a n — > oo have been considered in 
[5] , [8] , in relation with versions of the Erdos-Renyi law of large numbers 
for the small increments of a random walk, and [16]. 

The case when X is heavy tailed is considered in [1] where the authors 
consider the support of the distribution of the whole sample Xi, ..,X n 
when C holds for fixed a n . 

A closely related problem has been handled by statisticians in vari- 
ous contexts, exploring the number of sample observations which push a 
given statistics far away from its expectation, for fixed n. Although sim- 
ilar in phrasing as the so-called "breakdown point" paradigm of robust 
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analysis , the frame of this question is quite different from the robust- 
ness point of view, since all the observations are supposed to be sampled 
under the distribution P\, hence without any reference to outliers or 
misspecification. The question may therefore be stated as: how many 
sample points should be large making a given statistics large? This 
combines both the asymptotic behavior of the statistics (as a function 
defined on R") and the tail properties of Px- In the case when the statis- 
tics is Si/n and X has subexponential upper tail, it is well known that, 
denoting 

C a := {S?/n > a) 

only one large value of the AYs generates C a for a — > oo; clearly S n /n 
is not a loyal statistics under this sampling. This result turns back to 
Darling (1952). For light tails, under C a , all sampled values should 
exceed a (indeed they should be closer and closer to a as a — > oo), so 
that S n /n is faithfull in allegeance with respect to the sample. In this 
case, denoting 

I a := ft =1 (X, > a) 

it holds 

limP(J |C ) = l (7) 

a— >oo 

Intermediate cases exist, leading to partial loyalty for a given statistics 
under a given sampling scheme. See [7J , [3] , and [2] where more general 
statistics than S n /n are considered, and a — > oo. According to the tail 
behavior of the distribution of X the situation may take quite different 
features. 

Related questions have also been considered in the realm of statistical 
physics. In [13] the property ([7]) is stated in an improved form, namely 
stating that when the Aj's are i.i.d. with Weibull density with shape 
index larger than 2 then the conditional density of (Ai,..,A n ) given 
(Si/n = a) concentrates at (a, ..a) as a — > oo, which in the authors' 
words means that the X^s are democratically localized. Applications 
of this concept in fragmentation processes, in some form of anomalous 
relaxation of glasses and in the study of turbulence flows are discussed. 

We now come to a consequence of the present results considering 
the local behaviour of a random walk conditioned on its end value. Let 
S\ := Xi + .. + Xj with 1 < i < j < n and k = k n denote an integer 
valued sequence such that 

k n < n 

and 

lim k n = oo. 
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Let further 

denote the local slope of the random walk on the interval [j + l,j + k] 
where 1 < j < n — k. The limit behaviour of maxi<j< re _fe Aj n has been 
considered extensively in various cases, according to the order of mag- 
nitude of k. The case k = Clogn for positive constant C defines the 
so-called Erdos-Renyi law of large numbers; see [13]. In the present case 
we consider random walks conditioned upon their end value, namely 
assuming that 

S 1 ™ > na 

for fixed a > EX. We will prove that as n — > 00 the path defined by this 
random walk exhibits anomalous local behavior that can be captured 
through the extended democratic localization principle stated in our re- 
sults. Indeed there exist segments of length k n on which the slope Aj >n 
tends to infinity with a rate which can be made precise. Simulations 
are proposed in order to enlight this phenomenon. Obviously, when a 
is not fixed but goes to infinity with n then the extended democratic 
localization principle applies to the whole sample path of the random 
walk, and its trajectory is nearly a stright line from the origin up to its 
extremity. When conditioning in the range of the large deviation only, 
this property holds locally. 

This paper is organized as follows. Section 2 states the notation 
and hypotheses. Section 3 states the results in two cases; the first one 
pertains to the case when X has a log-concave density and the second 
case is a generalizetion of the former. Examples are, provided. Section 
4 presents a short account on the local behaviour of random paths from 
conditioned random walk, with some simulation. The proofs of the re- 
sults are rather long and technical; they have been postponed to the 
Appendix. 

2 Notation and hypotheses 

The n real valued random variables Xi, ...,X n . are independent copies 
of a r.v. X with density p whose support is M + . As seen by the very 
nature of the problem handled in this paper, this assumption puts no 
restriction to the results. We write 

p(x) := exp —h(x) 

for positive functions h which are defined and denoted according to the 
context. For x6R" define 

Ki<n 
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and for A a Borel set in IR n denote 



I h {A) = inf I h (x) . 
We A 



Two cases will be considered: in the first one h is assumed to be a 
convex function, and in the second case h will be the sum of a convex 
function and a "smaller" function h in such a way that we will also handle 
non log-concave densities. (although not too far from them). Hence we 
do not consider heavy tailed r.v. X. 

For positive r define 

S(r) = < x := (xi, ..,x n ) : ^ h(xj) < r > . 

I l<i<n J 

3 Very Large Deviation for Exponential Density 
Functions associated to Convex Functions 

Lemma 1 Let g be a positive convex differentiable function defined on 
K. + . Assume that g is strictly increasing on some interval [X,oo). Let 
(TJ]j hold. Then 

I g (I c nC) = min (F gi (a n ,e n ),F g2 (a n ,e n )), 

where 

1 



F 9l (a n , e n ) = g(a n + e n ) + (n - l)g ya n - n _^ n 
and 

F 92 (a n , e n ) = g(a n - e n ) + (n - l)g (a n + n \ ^ r}j ■ 

Theorem 2 Let X±,...,X n be i.i.d. copies of a r.v. X with density 
p(x) = cexp (— g(x)), where g{x) is a positive convex function on M + . 
Assume that g is increasing on some interval [X, oo) and satisfies 

lim g(x)/x = oo. 

x— >oo 

Let a n satisfy 

. \oga n 
lim int n > U 

rwoo logn 
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and that for some positive sequence e r 



nlogg(a n + e n ) 

hm — wi s — = °> ( 8 ) 

n^oo H{a n ,e n ) 

Urn 7 ^ = 0, (9) 
n-^oo H{a n , e n ) 



where 



H(a n ,e n ) = min {F gi (a n , e„), F g2 (a n , e n )) -ng(a n ), 
G{a n ) = g(a n + -^-) - a(a n ), 

where F gi (a n ,e n ) and F g2 (a n ,e n ) are defined as in Lemma [TJ Then as 
n — > oo it holds P{I\C) — > 1. 

Example 3 Let g(x) := x@ . For power functions, through Taylor expan- 
sion it holds 

9 (a n + -^—) - g(a n ) = — + o (—] = o (log g(a n )) 
V giflnjj a n \a n J 

hence condition holds as a consequence of (|SJ). If we assume that 
e n = o(a n ), by Taylor expansion we obtain 

min (F gi (a n , e n ), F 92 (a n , e n )) = na^ + Cl——^?- <1 <? n + o(a^- 2 e 2 n ). 
Condition (J5J) then becomes 

n\oga n 
lim — 5—^ — = 0. 



tin t n 



Case 1: 1 < /3 < 2. 

To ma£;e (P) /ioW, we need e n 6e /arge enough, specifically, 



a„ 2 Vlog «n = o (e n ) = o (a n ) 

which shows that e n — > oo. 
Case 2: /3 > 2. 

In this case, if we take n = a" u>zt/i < a < (3 — 2, then condition 
OH]) holds for arbitrary sequences e n bounded by below away from 0. The 
sequence e n may also tend to 0; indeed with e n = 0(1/ \oga n ) , condition 
(Q holds. Also setting a n := n a for a > there exist sequences e n which 
tend to such that the conclusion in Theorem® holds. 
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Example 4 Let g(x) := e x . Through Taylor expansion 

g (a n + — -, — r- ] - g(a n ) = 1 + o ( — J = o (log g(a n )) = o(a n ) 



g{a n ) 

and if e n — > 0, it holds 

min (F gi (a n , e n ),F g2 (a n , e n )) = ne a " + ^^—^^^l + o(e an e 2 n ). 

Hence condition (Q follows from condition (jSJ); furthermore condition 
(JHD follows from 

v na n 

lim = 

n— >oo fi"« 

if we set a n := n a where a > i/ien condition (Q holds, and e n is rapidly 
decreasing to 0; indeed we may choose e n = o(exp(— a n /4)). 

Corollary 5 Let Xi,..,X n be independent r.v's with common Weibull 
density with shape parameter k and scale parameter 1, 



p(x) 

where k > 2. Let 



kx k x e xl when x > 
otherwise, 



a„ = n a . 



for some < a < k — 2 and let e n be a positive sequence such that 

nloga n 
lim . 2 2 = 0. 

Then 

lim P(I|C) = 0. 



Proof: Set = x k — (/c — 1) logx, which is a convex function for 
k > 2. Also when x — > oo, g'(x) and are both infinitely small with 
respect to g(x) as x — > oo. 

Both conditions ([H]) and ([9]) in Theorem [2] are satisfied. As regards 
to condition (Q, notice firstly that, under the Weibull density by Taylor 
expansion 

g(a n + e„) = g(a n ) + g'(a n )e n + ^g"(a n )e 2 n + o (g"(a n )e 2 n ) . 
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Hence it holds 

log g(a n + e n ) < log(3a(a n )) < log (3a*) = log 3 + k\oga n . 
Using Taylor expansion in g(a n + e n ) and g (a n — -^rj), it holds 

F gi (a n ,e n ) - ng(a n ) = g(a n + e n ) + (n - l)g ^a n - — j - n#(a n ) 

#0n) + g'{a n )e n + -g"(a n )el + o (^"(a n )e^) 

+ f (n - l)#(a„) - g\a n )e n + ^"M^-^ + o (g"(a n )el)) - ng{a n ) 

> \g"{a n )el + o (g"(a n )el) = ^^a^ + o (a^) . 

In the same way, it holds when a n — >■ oo 

HA; — 1) 

F 92 (a n , e n ) - ng{a n ) > a k ~ 2 e\ + o (a k - 2 e 2 n ) . 



Thus we have 



ti l«n, e n J > a n e n + o [a n e n ) . 



Hence, when n — > oo, with (??), (??), the condition (jBJ) of Theorem 02J) 
becomes 

nlogg (a n + e n ) n log 3 + fcn log a n 



2fcn log a ra 8 n log a n 

The last step holds from condition (??). As for condition (Q of 
Theorem (J2J), when a n — > oo, it holds 

nG(a n ) = na ( a n + — -, — r- J - na(a„) 

= na(a n ) + n— — - + o — — - - ng{a n ) 
g(a n ) \g{a n ) J 

= n— ^ + o — — = o(n). 

Hence under condition (??), it holds nG(a n ) = o(H(a n ,e n )), which 
means that condition ([9]) of Theorem [2] holds under condition (??), which 
completes the proof. 



8 



4 Very Large Deviation for Exponential Density 
Functions associated to non-convex Functions 

In this section, we pay attention to exponential density functions whose 
exponents are non-convex functions. Namely, i.i.d random variables 
Xi, ...,X n have common density with 



assuming that the convex function g is twice different iable and q(x) is 
of smaller order than log g(x) for large x. 

Theorem 6 X\, ...,X n are i.i.d. real valued random variables with com- 
mon density f(x) = cexp (— (g(x) + q(x))), where g(x) is some posi- 
tive convex function on M + and g is twice differentiable. Assume that 
on[X, oo), g(x) is increasing on [X, oo) and satisfies 



Let M(x) be some nonnegative continuous function on R + for which 



as x —7- oo. 

Let a n be some positive sequence such that a n — > oo and e n = o(a n ) 
be a positive sequence. Assume 



f(x) = cexp 




lim g(x)/x = oo. 



M(x) < q(x) < M(x) for all positive x 



together with 



M(x) = (log g(x)) 



(10) 




(11) 



(12) 



(13) 



where 




min (F gi (a n ,e 



n 



)' -^92 \P"ni ^n)) 



ng(a n ), 




where F gi (a n ,e n ) and F 92 (a. 
Then it holds 



e n ) are defined as in Lemma^l 



P(I\C) ->■ 1 when n -> oo. 



9 



We now provide examples of densities which define r.v's X 4 "s for 
which the above Theorem applies. These densities appear in a number 
of questions pertaining to uniformity in large deviation approximations; 
see [15] Ch 6. 

Example 7 Almost Log-concave densities: p can be written as 

p(x) = c(x) exp —h(x), x < oo 

with h a convex function, and where for some Xq > and constants 
< C\ < C2 < oo, we have 

c\ < c(x) < c 2 for x < x < oo. 

Densities which satisfy the above condition include the Normal, the Gamma, 
the hyperbolic density, etc. 

Example 8 Gamma-like densities are defined through densities of 
the form 

p(x) = c(x) exp —h(x) 

for all x > 0, with < c\ < c(x) < c 2 < oo when x is larger than some 
Xq > and h(x) is a convex function which satisfies h(x) = r + h\(x) 
with, for x\ < X2, 

ailog— - bi < hi(x 2 ) - hAxi) < a 2 log— - b 2 

X\ X\ 

where a±, a 2 , b\ and 6 2 are positive constants with a 2 < 1. 

A wide class of densities for which our results apply is when there 
exist constants Xo>0,a>0,r>0 and A such that 

p(x) = Ax a ~ l l(x) exp (—TX) X > Xq 

where l{x) is slowly varying at infinity. 

Example 9 Almost Log-concave densities 1: p can be written as 

p(x) = c(x) exp — g(x), < x < oo 

with g a convex function, and where for some Xq > and constants 
< c\ < c 2 < oo, we have 

ci < c(x) < c 2 for Xq < x < oo, 

and g(x) is increasing on some interval [X, oo) and satisfies 

lim g(x)/x = oo. 

x— >oo 

Examples of densities which satisfy the above conditions include the Nor- 
mal, the hyperbolic density, etc. 
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Example 10 Almost Log-concave densities 2: A wide class of 
densities for which our results apply is when there exist constants Xq > 0, 
a > 0, and A such that 

p(x) = Ax a ~ 1 l(x) exp (-g(x)) x > xq 

where l(x) is slowly varying at infinity, g a convex function, increasing 
on some interval [X, oo) and satisfies 

lim g(x)/x = oo. 

x— >oo 

Remark 11 All density functions in Examples (Q f fTUj) satisfy the as- 
sumptions of the above Theorem . Also the conditions in Theorem 
about a n and e n are the same as those in the convex case, so that if g(x) 
is some power function with index larger than 2, e n can go to more 
rapidly than 0(1/ log a n )(see Example^); If g(x) is of exponential func- 
tion form, e n goes to more rapidly than any power l/a n (see Example 

m).* 

5 Application 

An extended LDP holds for the partial sum S™ where the i.i.d. sum- 
mands X^s are unbounded above whenever 

hm — r = 1 

n~>oo J-\X n ) 

holds where lim^oo x n = +oo. In the above display the Cramer function 
I(x) is defined for all x > EX through 

I(x) := sup tx — log E exp tX. 

t 

Thne following result holds (see [8], Proposition 1.1). Assume that X 
is unbounded above and satisfies the Cramer condition. Assume further 
that 

-\ogP(X > x) =I(x)(l + o(l))) (14) 
as x — > oo. Then for any sequence a n going to infinity with n it holds 

- log P (S?/n > a n ) = nl{a n ){\ + o{\))) (15) 

as n — > oo. It is readily seen that ( Tl4|) holds in any of the cases considered 
in the present paper (see [8], Remark 1.1). See also p[| for a sharp result. 

We now consider the local behaviour of a random walk with inde- 
pendent summands X i; 1 < i < n which are identically distributed as 
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X. Let a > EX . We consider random paths T n := (Si, Sf, .., S™) which 
satisfy (S™ > na) hence under a large deviation condition pertaining to 
the end value. In the following result we state that the trajectory T n 
exhibits a peculiar feature. 

Let k = k n be an integer sequence such that lim^oo k = oo together 
with lim^oo k/n = 0, and a n — > oo such that 

na — ka k 
lim — = oo. 

n-s-oo n — k 

Denote A k the event 

A k : = (there exists j, 1 < j < n — k such that A Jjfc > . 
It holds 

Proposition 12 When X satisfies the hypotheses in Theorem\^it holds 

P(A k \S? > na) -»■ 1. 
Proof. The proof is simple and we briefly sketch the argument. Clearly 

P ( A k \ S? > na) = 1 - P (n^ 1 (s£j +1 < ka^ | > na) 

< 1 - (P (5* < fca fc | > na)) [ " /fcl =: 1 - P. 

Now applying Bayes Theorem and the independence of the r.v's X^s, it 
holds 

P > na) 

Under the present hypotheses (JHj) holds. Using ffl5l) in the numerator 
and the classical first order LDP result 

log P (SI > na) = -nl(a) (1 + o(l)) 

in the denominator, it follows that P — > as n — > oo, which concludes 
the proof. ■ 

The consequence of Theorem [6] is that on this segment of length k 
where the slope exceeds a k all the summands are of order a k so that the 
behaviour of the trajectory is nearly linear. Numerical evidence confirm 
the theoretical ones; for very large a and fixed (large) n , not surprisingly, 
the democratic localisation holds on the entire trajectory , in accordance 
with the results in this paper; therefore T n is nearly a straight line from 
the origin up to the point (n, na n ). For smaller values of a (typically for 
a defined through P (S™ > na) of order 10 -3 the phenomenon quoted in 
the above proposition holds: T n consists in a number of oblic segments. 
When n is allowed to increase, the segments are longer and longer, with 
increasing slope. 



12 



6 Appendix 

6.1 Proof of Lemma [I] 

Write x = (xi, ...,x n ) £ IR™, we firstly define the following sets. Let for 
all k between O and n 

Ak := {there exist i±, .., i& such that Xi- > a n + e n for all j with 1 < j ' < k} 
and 

-8^ := {there exist ii, .., such that a?j. < a n — e n for all j with 1 < j < k} . 
Define 

Un 
limAfc 
fe=i 



and 



It then holds 



It follows that 



B = {j\\mB k . 

r = A U B. 



ijrnc) = ia((AuB)nc) = inf /„(x) 
= min (/ 9 (inC),/ 9 (5nC)). 

Thus we may calculate the minimum values of both I g (A fl C) and 
l g [B D C) respectively, and finally I g (I c n C). 
Step 1: In this step we prove that 

I g (ADC) = F gi (a n ,e n ). (16) 

Let x := (xi, x n ) belong to AnC and assume that I g (AnC) = / 9 (x). 
Without loss of generality, assume that the ordered ascendently, 

X\ < ... < Xi < Xj + i<, ... < x n and let i and k := n — i with 1 < i < n 
such that 

n—k k 



Xi < ... < Xi < a n + e n < x i+1 < ... < x n . 

We first claim that k < n. Indeed let y := (yi = a n — e n , y 2 — ... = y n -i = o, n + e n ) 
which clearly belongs to A fl C. For this y it holds I g (y) — (n — l)g(a n + 
e n) + g{.0"n — e n ) which is strictly smaller than ng(a n + e n ) = I g (A n fl C) 
for large n. We have proved that x does not belong to A n fl C. 
Let ctj+i, ...,a n be nonnegative, and write Xi+±, ...,x n as 

G n -|- d n -\- Q!j_|_i, . ..,X n CL n -\- a n -\- OL n . 
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Under condition (C), it holds 

X\ + ... + Xi > na n — (x i+ i + ... + x n ) 

= na n - k(a n + e n ) - (a i+1 + ... + a n ) . 

Applying Jensen's inequality to the convex function g, we have 

n 

^2 g ^ = (9(x i+1 ) + ... + g(x n )) + (g-(xi) + ... + g(xi)) 

i=l 

> (9(?i+i) + ••• + g(x n )) + (n - k)g(x*), 
where equality holds when X\ — ... — Xj = x*, with 

na n - k(a n + e n ) - (a i+1 + ... + a n ) 



x 



n — k 



Define now the function function (a»+i, a n , k) — > f(ai + x,...,a n ,k) 
through 

f(a i+1 , a n , k) = g(x i+ i) + ... + g(x n ) + (n - k)g(x*) 

= g(a n + e n + a i+1 ) + ... + g(a n + e n + a n ) + (n - k)g(x*). 

Then I g (A D C) is given by 

I g (AnC)= inf f(a i+1 ,...,a n ,k). 

ai+i,...,a„>0,l<k<n 

We now obtain f|T6|) through the properties of the function /. Using (??), 
the first order partial derivative of f(a i+ i, ...,a n ,k) with respect to a i+ i 
is 

g/(q i+ i,..,q n ,fc) , , 

a = # (On + Cn + a i+ i) - # (a ) > 0, 

where the inequality holds since g(x) is strictly convex and a n + e n + 
tti+i > x*. Hence /(c^+i, a n , fc) is an increasing function with respect 
to This implies that the minimum value of / is attained when 

oii+i = 0. In the same way, we have a^+i = ... = a n = 0. Therefore it 
holds 

I g (AnC)= inf /(0,fc), 

l<fc<n 

with 

/(0, fc) = kg(a n + e n ) + (n - k)g(x* Q ), 

where 

k 

n — fc 
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The function y — > f(0,y) with < y < n is increasing with respect to 
y, since 

9f(0,y) ne n 

g{a n + e n ) - g(x ) g (x ) 



ay n — y 

ne n ( g(a n + e n ) - g(x* 



-g'(x* )) >0 



n-y \ a n + e n -xl 

due to the convexity of g(x) and a n + e n > Xq. Hence /(0, k) is increasing 
with respect to k; the minimal value of f(0, fc)attains with k — 1. Thus 
we have 

I g (AnC) = f(0,l) = F gi (a n ,e n ) 

which proves (1161) . 

Step 2: In this step, we follow the same proof as above and prove 
that 

I g (BnC) = F g2 (a n ,e n ). 

With x defined through / 9 (x) := I g (B D C) with the coordinates of x 
ranked in ascending order, with j such that 1 < j < n and 

j n-j 



X\ < ... < Xj < a n + e n < Xj + i < ... < x n 

we obtain j < n through the same argument as above. Denote Xx,...,Xj 
by 

X\ d n € n OL\i X n (X n € n Cfcj 

where a%,...,aj are nonnegative. Under condition (C), it holds 

x j+ i + ... + x n > na n - (x\ + ... + xj) 

= na n - j(a n - e n ) + (a ± + ... + a>j) . 

Using Jensen's inequality to the convex function g(x), we have 

n 

^2g(%i) = (g(xx) + ... + g(xj)) + (g(xj+x) + ...+g(x n )) 

i=l 

> {g( Xl ) + ... + g{ Xj )) + (n- 

where the equality holds when Xj + i — ... = x n = with 

tt _ na n - j(a n - e n ) + (qi + ... + otj) 
n-j 
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Define the function (a i+ i, a n , k) — > f(a i+ i, a n , k) through 

/(«!, ...,aj,j) = g(x x ) + ... + g(xj) + (n-j)g(i 1 ) 

= g(a n - e n - «i) + ... + #(a n - e„ - a,) + (n - j)g(x^, 

then I g (A D C) is given by 

J 9 (AnC)= inf f{a u ...,a h j). 

Using (??), the first order partial derivative of f(ai,...,aj,j) with 
respect to a>\ is 

-r = -g [a n -e n -a x )+g > 0, 

where the inequality holds since g(x) is convex and a n — e n — a.\ < x*. 
Hence f(a±, ...,ctj,j) is increasing with respect to a\. This yields 

ai = ... = otj = 0. 

Therefore it holds 

I g (BnC)= inf /(0, j), 

l<k<n 

with 

/(o,j) =jsK-6 ll ) + (fi-j'M4 

where 

tt _ J 

n-j 

The function y — > f(0, y) with < y < n is increasing with respect to 
y, since 

^ = S-K - e n) - g(xl) + -^-.g\xl) 
ay n — j 



g'(xl) - ^ »' r > 



n-y \ xl - (a n - e 



by is convexity of g ; in the above display x > a n — e n . Hence /(0, k) is 
increasing with respect to k. Thus we have 

I g (B n C)=f (0,1) = F g (a n ,e n ) 

which proves the claim. 

Thus the proof is completed using f|T6|) and (??). 
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6.2 Proof of Theorem H 

For x = (xi, ...,£„) G M", define 



S^r) = < a; : ^ 

I l<i<r, 



g(Xi) <r}. 

i 

Then for any Borel set A in M. n it holds 
P(A) = / exp — 2_, p( x i) J dxx, ...,dx n 

jA V l<i<n / 

= exp(-I g (A)) J^dxi,...,dx n J 1 [ El ^ n9( , ! )-/ 9 (A),oo)( s ) e " Srfs 

/"OO 

= exp(-J fl (A)) / yokme(A n S g (I g (A) + s))e- s ds. 
Jo 

The proof is divided in three steps. 
Step 1: We prove that 

P{C) > c n exp (-I g (C) - r n -n\ogg{a n )) . (17) 

where 

r n = ng (a n + ) - ng(a n ). (18) 

By convexity of the function g, and using condition (C), applying 
Jensen's inequality, with it holds 

I g {C) = ng(a n ). 

We now consider the largest lower bound for 

log Volume (C D S g (I g (C) + r re )) . 

Denoted = |x : z< G [an,a n + ^y]|, 5' 9 (/ g (C , )+r n ) = {x : X^i^) < 

710 (a n ) + r n }. 

For large n and any x := (xi, .., x n ) in B, it holds 

y]fi'(^) < y]0(an + -7 — r) = ng(a n + — — -) = ng(a n ) + r„, 

where we used the fact that g is an increasing function for large argu- 
ment. Hence 

BcS g (I g (C) + r n ). 
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It follows that 



( i Y 

logVolume (C D S 9 (I g (C) + r n )) > logVolume(B) = log I — - — r J = — nlog g(a n ) 

(19) 

which in turn using (??) and (fT9l . implies 
logP(C) :=log / exp I - ^ 9( x i) ) dxi,...,dx n 

^ C \ l<i<n / 

> log (exp(-I g (C)) j Volume(C n S g (I g (C) + s))e~ s ds\ 

> -I g (C) - r n + \ogVolume(C n S fl (/ ff (C) + r n )) 

> -I 9 {C) - r n -nlogg(a n ), 

This proves the claim. 

Step 2: In this step, we prove that 

P(I C n C) < c n exp (-/ 3 (/ c n C) + n log J 9 (J C n C) + log(rj + 1)) . 

(20) 

For any Borel set A in M. n it holds , for positive s, let 
S g (I g (A) + s) = | x : £ ^(x,) < I g (A) + s 1 

and 

F = {x : < + s, i = 1, n} . 

It holds. 

S g (I g (A) + s)cF. 
Since lim^oo g{x)/x = +oo 

F C {x : Xi < (I g (A) +s),i = l,...,n}, 

which yields 

S g (I g (A) + s) C {x : Xi < {I g {A) + s), i = 1, n}, 
from which we obtain 

Volume(A n S g (I g (A) + s)) < yoZume(S 9 (/ g (A) + s)) < (/ 9 (A) + s) n . 
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With this inequality, the upper bound of integration (??) can be given 



when a n — > oo. 



logP(A) =log / exp - ^ 9{%i) dx!,...,dx n 

Ja \ l<i<n / 

poo 

= -I g (A) + log / Volume(A n S g (I g (A) + s)) e - s ds 
Jo 

POO 

<-I g (A) + log / (/ fl (A) + S )"e- s cZ S , 

Jo 

with integrating repeatedly by parts it holds 

POO 

/ (I g (A) + s) n e- s ds (21) 
Jo 

POO 

= I g (A) n + n / + s) n ~ l e~ s ds 

Jo 

POO 

= I g (A) n + nI g (A) n ~ l + n(n -I) (I g (A) + s) n " 2 e~ s ds 
<(n + l)I g {A)\ 
hence we have 

log / exp - ^ g(xi) dx 1 ,...,dx n 

jA \ l<i<n J 

<-I g (A)+log((n + l)I g (Ar) 

= -I g (A)+n\ogI g (A) + \og(n + l). 

Replace A by I c fl C. We then obtain 

P(/ c nC)< c n exp {-I g {I c n C) + nlog/ 9 (/ c n C) + log(n + 1)) 

as sought. 

Step 3: In this step, we will complete the proof , showing that 

Hm P(J :^ C) =0. 

a„->oo P(C) 

By Lemma [U 

I g (I c n C) = min (F gi (a n ,e n ),F g2 (a n ,e n )) . 
Using (HU) and ([20} it holds 

p(/ c n c) 

< exp (-H(on, e n ) + n\ogI g (I c n C) + r n + nlog#(a n ) + log(n + 1)) 
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Under conditions fl£J]), by (fTSj) when a n — > oo, we have 

r n _ nG{a n ) ^ 

H(a n ,e n ) H(a n ,e n ) 

Using conditions (??) and (jHJ), when a n — > oo, 

raloga(a n ) log(n+l) 
0, ana 



H(a n ,e n ) H(a n ,e n ) 

As to the term n log I g {I c DC), we have 

nlog/ 9 (7 c n C) = nmin (F gi (a n , e n ), F 92 (a n , e n )) 
< ralog (ng(a n + e n )) 
= n log n + n logo (a n + e n ) . 

Under condition (jSJ), when a n — > oo, nloga (a n + e n ) is of small order 
with respect to H(a n ,e n ) as n tends to infinity. Under condition (??), 
for a n large enough, there exists some positive constant Q such that 
logn < Qlogg(a n ). Hence we have 

nlogn < Qn log g(a n ) 



which under condition OH]), yields that nlogra is negligible with respect 

3n a n y oo, it hoi 

nlog(/ 3 (/ c nC)) 



to H(a n , e n ). Hence when a n — > oo, it holds 



H(a n , e n ) 



0. 



Further, (??), (??) and (??) make (??) hold. This completes the proof. 
6.3 Proof of Theorem [6] 

The proof is is the same vein as that of Theorem [2j some care has to be 
taken in order to get similar bounds as developped in the convex case. 
Denote x = (xi, x n ) in W 1 and, for a Borel set A e M + " define 

I g>q (A) = inf I g>q {x), 



where 



Ki<n 



Also for any positive r define 



S 9,q( r ) 



\ x : Yl (9(xi) + q(xi)) < 

L l<«<n. 
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Then it holds 



P 




poo 

= exp(-J fliff (A)) / Volume(An S g , q (I g , q (A) + s))e- s ds. (22) 
Jo 



Step 1: In this step we prove that 

Ig,q(P) > Igi( C ) > nh(a n ) = ng(a n ) - nN log g(a n ). 
For large x it holds 

g(x) - M{x) < g(x) + q(x) < g(x) + M(x). (23) 
Set gi(x) = g{x) — M(x) and g2(x) = g{x) + M(x), then it follows 

I gi {C)<I m {C)<I m {C). (24) 
In the same way, it holds 

/ 51 (/ c nc)< i m {r n C) < / 92 (/ c n C). (25) 

By condition (TTU]) . there exists some sufficiently large positive y and 
some positive constant N such that for x G [yo ; oo) 

M(x) < N\ogg(x). (26) 

Set r(x) = g(x) — Nlog g(x), the second order derivative of r(x) is 

^)=/w(i--?t)*, 

where the second term is positive. The function g is increasing on some 
interval [X, oo) where we also have g(x) > x. Hence there exists some 
yi G [X, 00) such that s g(x) > N when x G [yi, oo). This implies that 
r"{x) > and r'(x) > and therefore r(x) is convex and increasing on 
[2/i,oo)- 

In addition, M(x) is bounded on any finite interval; there exists some 
Vi ^ [yi 1 00 ) suc h that for all x G (0, y 2 ) 

M(x) <N log g(y 2 ). (27) 
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The function g is convex and increasing on [y 2 , oo). Thus there exists y 3 
such that 

g\y 3 )>2g'{y 2 ) and g(y 3 ) > 2N. (28) 
We now construct a function h as follows. Let 

h{x) = r{x)l [y3>oo) {x) + s{x) l^g) {x), (29) 

where s(x) is defined by 

s(x)=r(y 3 ) + r'(y 3 )(x-y 3 ). (30) 

We will show that 

9i(x) > h(x) (31) 

for x G (0, 00) . 

If x G [y 3 , 00), then by (126]) . it holds 

/i(x) = r(x) = </(x) — Nlogg(x) < g(x) — M(x) = g\(x). (32) 

If x G (2/2,2/3), using (1301) . we have 

s(x) < r(x) = g(x) — N\ogg(x) < g(x) — M(x) = gi(x), (33) 

where the first inequality comes from the convexity of r(x). We now 
show that ( l3Ti) holds when x G (0,2/2] if 2/3 is large enough. For this 
purpose, set 

t(x) = g(x) - s(x) - N log (7(2/2) • 

Take the first order derivative of t and use the convexity of g on (0,2/2]- 
We have 

t'(x) = g\x) - s'{x) = g'{x) - r'(y 3 ) = g\x) - (g\y 3 ) - 

= 9'(x) - (l - JL) c/'(y 3 ) < - (l - ^y) ^(2/3) 

4^) -(l-^)^3)<0, 

where the inequalities in the last line hold from ( 128]) . Therefore t is 
decreasing on (0,2/2]- It follows that 

*(a0 > t(y 2 ) = g(y 2 )-N log g(y 2 )-s(y 2 ) > g(y 2 )-N log g(y 2 )-r(y 2 ) = 0, 
which, together with fl27|) . yields, when x G (0,2/2] 

S'iO) = fl'(^) - M(x) > g(x) - Nlogg(y 2 ) > s(x). 
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Together with (I3"2"j) . (1331) . this last display means that (13T]) holds. 

We now prove that h is a convex function on on (0, oo).; indeed for x 
such that < x < y 3 , h"(x) = 0, and if x > y 3 , h"(x) = r"(x) > 0. The 
left derivative of h(x) at y 3 is h'(y 3 ) = r'(y 3 ), and it is obvious that the 
right derivative of h(x) at y 3 is also h'(y^) = r'(y 3 )] hence h is derivable 
at y 3 and h'(y 3 ) = r'(y 3 ), hence h"(y 3 ) = r"(y 3 ) > 0. This shows that h 
is convex on (0, oo). 

Now under condition (C), using the convexity of h and ( )3T|) . it holds 

J 91 (x) = (9( x i) ~ M (^)) > E &(*0 > ^ ( ) = ^M- 

j=l i=l ^ 



Using ( |24|) . we obtain the lower bound of I g>q (C) under condition (C) 
for a n large enough (say, a n > y 3 ) 

Ig, q ( C ) > IgiiP) > n K a n) = nr(a n ) = ng(a n ) - nNlogg(a n ). (34) 

Step 2: In this step, we will show that the following lower bound of 
P(C) holds 

P{C) > c n exp (-I g , q (C) - r n -n\ogg(a n )) , (35) 
where r n is defined by 

T n = ng \a n + — ; — T J - n#(a n ) + nNlogg ( a n + — : — r- J + nN\ogg(a n ) 

(36) 

1 



nG(a n ) + nN log #(a re ) + niV log g ( a n 



Denote B — |x : Xi G [a n ,a n + ^^y]-| . If x G £>, by fl26l) . which 

holds for large n (say, a n > y 3 and assuming that g is an increasing 
function on (y 3 , oo)), we have 

n n 

Wx) < ^ (^(st) + M(xi)) < (9(xi) + N log g(xi)) 

i=l i=l 



ng [a n + — -, — r J + nNlogg ( a n + — ; — r 
r n + ng{a n ) - nN "log g(a n ) < r n + / ff ,,(C) 
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where the last inequality holds from (j31]> . Since B C C, we have 

BcCn5 M (J M (C)+r n ). 

Now we may obtain the lower bound 

log Volume (C H S g q (I g q (C) + r n )) > logVolume(B) = —nlogg(a n ). 

(37) 

Using ([22]) and ([37D, it holds 

^ \ l<i<n / 

/■oo 

= -WC) + log / Volume{C n S gtq {I Btq {C) + s))e~ s c/s 
Jo 

/■OO 

> -/ g>9 (C) + log / VoZume(C n S g , q (I g , q (C) + r n ))e" s cfe 

> -I g , q (C) - r n -nlogg(a n ), 
so (J35D holds. 

Step 3: We prove that 

P(/ c nC) < c n exp(-/ 5g (r nC) +nlog/ 9 (/ c nC) + log(n + 1) +nlog2) 

(38) 

For any Borel set A in and any positive s, 

S Biq {I g , q {A) + s) = I x : ^ (g(xi) + < W^ 4 ) + s \ 

L l<i<n J 

is included in {x : g{xi) + ^(xj) < I g>q (A) + s,i = 1, n} which in turn 
is included in F = {x : g(xj) — M(xj) < (7 Si9 (A) + s),i = 1, ...,n} by 

(EHD. 

Set H = {x := (xi, .., x n ) : x« < 2(I gtq (A) + s),i = 1, n}, we will 
show it holds for a n large enough 

F CH. 

Suppose that for some x := [x\, ..,x n ) in F ,some Xi is larger than 2(I gtq (A) + 
s). For a n large enough, by (I3"3j) . it holds 

Xi > 2(I g>q (A) + s)>2 (ng(a n ) - nN log g(a n )) 

> 2 (ng(a n ) - -ng{a n ) J = -ng(a n ). 
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Since ~ng(a n ) > \na n for large n, by (1261) and since x —> g(x) — 
N\ogg(x) is increasing, we have 

g{ Xi ) - M( Xi ) > g{ Xi ) - Nlogg(x t ) > g {2{I m {A) + s)) -N\ogg (2{I g>q {A) + s)) 
>g(2(I g>q (C) + s))-±g(2(I g , q (C)+s)) 

> \ {2{I m {C) + s)) = I m {C) + a. 

Therefore since x £ F, Xj < 2(I gtq (A) + s) for every i, which implicates 
that (??) holds. Thus we have 

S M {I M {A) + s)GH, 

from which we deduce that 

Volume (A n S g>q {I g , q {A) + s)) < Volume {S g>q (I g>q (A) + s)) 

< Volume(H) = 2 n (I fJyq (A) + s) n . 

With this inequality, the upper bound of integration (l2~2i) can be given 
when a n — > oo through 

log / exp I - ^ id( x i) + <?(>*)) I dx 1 ,...,dx n 

■* C \ l<i<n J 

poo 

= -I g , q (A) + log / Volume{A n S g , q (I g>q (A) + s))e~ s ds 
Jo 

POO 

< -I g , q (A) + log / (I g>q (A) + s) n e~ s ds + n log 2. 

■/ o 

According to (12"TT) . it holds 

/"OO 

/ (J flia (A) + s) n e~ s ds < (n + 1)7^(4)", 
>/ o 

Hence we have 



log / exp - {g{xi) + q{xi)) dx u ...,dx n 

< -I g , q (A) + log ((n + + nlog2 

= - + n log 7 flj9 (A) + log(n + 1) + n log 2. 



Replacing A by 7 C n C yields (EHj). 

Step 4: In this step, we derive crude bounds for 7 92 (C), 7 5l (7 c H C) 
and J S2 (/ c nC). 
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From (}2"oT) and (|2"T|) . there exists some a n G [X, oo) (say, a n > y 2 ) 
such that 

M(x) < maat(N log g(a n ),N log g(x)) (39) 
holds on (0, oo). Hence for a n large enough 

g 2 (x) = g(x) +M(x) < g(x) + max(iV log g(a n ), N logg(x)), 

which in turn yields 

/ n n \ 

/ 92 (C) < mf [^gixi) + Y,™x(Nlogg(a n ),Nlogg(x l )) ) . (40) 
It holds 

inf VVax(iV log g(a n ),N log gfa)) = nN log g(a n ) (41) 
xec \ • ' 

\i=i 

which implies that 



,i=i i=i 



[ ^fi-(xi) + ^2m&x(N logg(a n ), N log g(xi)) 

\i=l i=l , 

ini r Yl 9 ^ + hif ^max(iV log # (a n ),iV log #(£;)) 



j=i / \j=i 



lec ( X^( x< ) J +nN log g(a n ) 
I g (C) + nN log g(a n ) = ng(a n ) + nN "log g{a T 



Thus we obtain the inequality 

I 92 (C) < ng(a n ) +nN log g(a n ). (42) 

We now provide a lower bound of I gi (I c r\C). Consider the inequality 
of (I3~T|) in Step 1, where we have showed that h is convex for x large 
enough; hence, using (I3TT) when a n is sufficiently large, it holds 

/ 9l (fnC) > 4(/ c nC) =mm(F hl (a n ,e n ),F h2 (a n ,e n )), 

where the second inequality holds from Lemma [TJ By the definition of 
the function h in (1291) . for large x it holds /i(x) = r{x) which yields the 
following lower bound of I gi (I c fl C) 
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/ 91 (/ C nC)> I h (I c n C) = I r (I c n C) = min (F ri (a n , e n ), F r2 (a n „ e n )) 
By Lemma CD, it holds 

F ri (a n , e n ) = g(a n + e n ) + (n - l)g \a n 3_e n 

V n — 1 / 

- N log g(a n + e n ) - (n - l)N\ogg ( a n ^_e n 

\ n—l 

> g(a n + e n ) + (n - 1)# - niVlogg (a n + e n ) 

by the same way, we have also 

F r , 2 (a n , e n ) > g(a n - e n ) + {n- l)g (a n + ^—^t^J ~ nN log g (a n + e n ) , 
hence 

I 91 (I c DC) > min (F gi ( )) - nN log g (a n + e n ) 

holds. 

The method of the estimation of the upper bound of I 9l (I c PI C) is 
similar to that used for I 9l {C) above. In (HU1) . replace C by I c D C; we 
obtain 



I 92 (I c nC)< inf V + Vmax(iVlog^(a n ),iVlog^(x i )) 
xe/ c nc \ ^— • *■ — ' 

\i=l i=l , 

- xifcnc ( + ^max(iVlog# la n + J , N log g(xi)) J . 

\ i=l i=l ^ ' J 



Similarly to flH|), it holds 



inf ( VVax(iVlogSf ( a n H ^— ) ) Nlogg{x i )) I = nNlogg ( a n H 

xe/ c nc \ \ n — l J J \ n—l 

where equality is attained setting x\ = ... = x n ^\ = a n + e n /(n — l),x n = 
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On — e n . Hence we have, when n — > oo 



= ^ ^"12 9 + nN log g (a n + -^—) 

i=i v 7 



= I g ( J c n C) + nN log <? ^a n + 

< #(a n - e n ) + (n - l)g (a n + ^—^^ + nN log g (^a n + ^jyj 

< ng (^a n + ^^jj + nN log g (a n + ^^jj 



<n(N + l)g[a n + 



n — 1 



Therefore we obtain 



log I 92 (I C n C) < logn + log(iV + 1) + log # (^a n 



(43) 



n — 1 

Step 5: In this step, we complete the proof by showing that 

iim p(/ ;q C) =o. 

a n ^oo P\C) 

Using the upper bound of P(I C D C), together with the lower bound 
of P{C) above, we have under condition ffTTj) when a n is large enough 

P(i c n C) (- (i^(P n C) - i m {C)) + nio g i m {P n C) 

P(C) ~ P V +^ + nlog^(a n ) + log(n + 1) + nlog2 

< exp (- (J 9i9 (/ C n C) - I g , q (C)) + nlogI 9tq (I c HC) + r n + 2nlog g{a n )) 

< exp (- (/ ffl (/ c n C) - I 92 {C)) +nlogI g2 (I c nC) + r n + 2n log g(a n )) . 

The last inequality holds from (pi]) and (125]). Replace J 9l (7 c nC), J fl2 (C) 
by the upper bound of and the lower bound of (??), respectively, 
we obtain 

I gi (I c nC) - I 92 (C) > min (F gi (a n ,e n ),F g2 (a n ,e n )) - nN log g (a n + e n ) 

- {ng(a n ) + nN log g(a n )) 
= H(a n ,e n ) - nN log g(a n + e n ) - nN log g(a n ) 
> H{a n , e n ) - 2nN log (a n + e n ) . (44) 
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Under condition (ITT]) , there exists some Q such that n log n < Qn log g(a n ), 
which, together with (j43p and (j44p . gives 



P(I C n C) f-(H(a n ,e n )-2nN\og(a n + e n )) + nlogn + n\og(N + 1)' 

P(C) ~ eXp \ +n\ogg (a n + ^) + r n + 2n log g(a n ) 



exp 



-H(a n , e n ) + n(2N + 1) \og g(a n + e n ) 
-T n + 2nlogg(a n ) + nlogn + n\og(N + 1) 

< exp (-H(a n ,e n ) + n(2iV + 1) logy (a n + e n ) + r n + 2nlogsf(a n ) + 2nlogn) 

< exp (-H(a n , e n ) + n(2N + 1) logy (a n + e n ) + r n + (2Q + 2)nlogy(a n )) 

< exp (-H(a n , e n ) + n(2iV + 2Q + 3) logy (a n + e n ) + r n ) . 

(45) 

The second term in the bracket in the last line above and r n are 
both of small order with respect to H(a n ,e n ). Indeed under condition 
(fT2"|) . when a n — > oo, it holds 

n(2iV + 2Q + 3)logy(a n + ^) 

hm — r = 0. (46) 

n^oo H(a n ,e n ) 

For r n which is defined in fl36l) under conditions ffl~2]) . ([TBI . niV log y(a n ) 
and nG(a n ) are both of smaller order than H(a n , e n ). As regards to the 
third term of r n , it holds 

nN log g (a n + — — J = nAHog (g ( a n + -p— r J - y(an) + #K 

< niVlog (2max(G(a n ),y(a„))) 
= nA^ log 2 + max (nN log G(a n ), nN log g(a n )) . 

Under conditions (|T2|) and (fT3|) . both nAlogG(a n ) and nN log g(a n ) 
are small with respect to H(a n ,e n ); therefore nNlogg (a n + l/g(a n )) is 
small with respect to H(a n , e n ) when a n —> oo. Hence it holds when 
a n —> oo 

lim — - — - — - = 0. 

n^oo H(a n , e n ) 

Finally, fi^j) . together with (T4"6"j) and (??), implies that (??) holds. 
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